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(54) INTEGRATED PHOTOGRAPHING APPARATUS MOUNTED ON AIRCRAFT 

(57) An apparatus for continuously photographing 
the ground from an aircraft and recording image data as f i g i 

direct digital data on the real time basis. A line sensor 
directed in a vertical direction is disposed at an interme- 
diate part between two line sensors directed slantingly 
f onward and slanting backward . and these three parallel 
line sensors constitute a three-line-sensor camera. This 
camera is mounted on the aircraft. A gyro is assembled 
integrally with this ttiree- line-sensor camera. arKi the 
ground images are recorded and reproduced according 

Jo, ppsture„data,of .the.camera .outputted.from.the .gyro, . _ . 

the position data of the aircraft obtained from a GPS 
and digital image data of the three-line-sensor camera. 
Since the gyro is integrally assembled with the camera, 
the optical axis of the camera can be always directed in 
the vertical direction. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention: ■ 

The present invention relates to an airborne apparatus for photographing a selected piece of ground surface to pro- 
vide data of ground image for determining the shape and height of the land. 

Description of the Prior Art: 

Airphotographs have been widely used for determining the shape and height of a selected piece of land. In general, 
airphotographs are taken of overlapping area sections of a selected piece of land, thereby providing a series of latent 
images taken at regular intervals on a film. The fOm is developed, and the developed images are printed. 

Alternatively, an airtxjrne scanner-and-line sensor is used to provide required land images in the form of digital 
data. 

Each of the series of the so taken pictures, however, is made up by collection of image fractions recorded by beams 
of light reflected in different directions, and therefore such collection of image fractions is not continuous. In addition to 
this problem the image quality varies with the photosensitivity of the film, developing and printing conditions and other 
factors. 

Nobody could tell what image is like before developing, and therefore, if pictures are found to be defective or use- 
less after developing, same pictures have to be taken again. 

To determine the shape and height of a selected piece of land from airphotographs three coordinate points Xq, Yq 
and Zq of the instantaneous position of the airborne camera and three inclinations about three coordinate axes © . ^ 
and u must be determined analytically by using known points (reference points) in the coordinate system. A lot of work 
Is required for finding the reference points in the coordinate system. 

~ To automatize such airphbtographing-and-analyzing work it is necessary to analogue-to-digitarconvertthedevel- — 
oped film for digitization. 

The present invention aimes at photographing continuously a selected piece of land by an airtx>rne three-line sen- 
sor camera, and at making a record of the data of land image in the form of digital data directly from the so taken air- 
photographs. Also, the present invention aimes at effecting feedback control of the attitude of ttie airborne camera by 
using attitude data provided by a gyro associated with the three-line sensor camera, thereby setting the camera so that 
its optical axis may be vertical at all times, tiius assuring that distortion-free images may be provided. Finally, the 
present Invention aimes at making a record each of the attitude data provided by the gyro and tiie instantaneous posi- 
tion data provided by a GPS in addition to tiie record of land image data recorded in the form of digital data, tiiereby 
permitting a required correction to be made later by using appropriate softwares. 

SUMMARY OF THE INVENTION 

An airborne photographing apparatus according to the present invention comprises: an airborne three-line sensor 
camera for taking pictures of a selected piece of land; a gyro mounted in the housing of the three-line sensor camera 
for determining the attitude of the camera while photographing; a GPS for providing the instantaneous position data of 
the camera in the three-dimensional space; a stabilizer for controlling the attitude of the camera to set its optical axis to 
be vertical at all times, and at ttie same time for absorbing the vibration of tiie aeroplane; a data processing unit for 
processing the attitude data from the gyro and the position data from the GPS and outputting signals for controlling the 
stabilizer; a data recorder for recording the land image data from the camera, the attitude data from the gyro and the 
position data from the GPS; an image display for showing the land image data from the camera; and a data analyzer 
for converting the land image data from the camera into the land image data given in terms of fixed coordinates on the 
basis of the land image data, attitude data and position data all recorded by the data recorder, and for outputting the so 
converted land image data. 

The airborne three-line sensor camera is used in taking picUjres of a selected piece of land. 

The gyro is mounted in the housing of the three-line sensor camera, and is used in providing data of the attitude of 
the camera while photographing. 

The GPS is used in determining the instantaneous position data of the camera while photographing in the three- 
dimensional space. 

The stabilizer functions to control the attitude of the camera to set its optical axis to be vertical at all times, and at 
the same time, absorb the vibration of the aei-oplane. 

The data processing unit is used in processing the attitude data from the gyro and the position data from the GPS 
and outputting signals for controlling the stabilizer 
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The data recorder is used in recording tlie land image data from the camera, the attitude data from the gyro and 
the position data from the GPS ail together. 

The image display is used in showing the land Image data from the camera. 

The data analyzer is used in converting the land image data from the camera into the land image data given in 
5 terms of fixed coordinates on the basis of the land image data, attitude data and position data all recorded by the data 
recorder, and for oulputting the so converted land image data. 

With this arrangement the instantaneous position of the three-line sensor camera (Xq Yq and Zq) and the inclina- 
tions of the camera about three coordinate axes [oa, ^ and u) can be determined for each minute time, that is, as a func- 
tion of time, thus making the reference point-finding work unnecessary, or reducing such work to possible minimum. 
10 Also, the stereomatching can be performed by using a conputor. These can provide technical innovations. 

The conventional stereomatching determines a three dimensional coordinate on a selected piece of land by deter- 
mining the crossing of two beams of light projected at different angles. In contrast, the three-line sensor system adopted 
by the jaresent invention uses three different beams of light projected vertically, fonward-obiiquely and backward- 
obiiquely respectively, and therefore, it has a redundancy enough to permit a required error checking, and accordingly 
15 the accuracy with which the siiape and height of a piece of land can be determined is improved. 

BRIEF DESCRIPTION OF THE DRAWING 

Other objects and advantages of the present invention may be understood from the following description of a pre- 
20 ferred embodiment which is shown in the accompanying drawings: 

Fig.1 is a block diagram of an airborne photographing apparatus according to one embodiment of the present 
invention; 

Fig. 2 shows how the airborne three-line sensor camera works; 
25 Fig.3 shows how the GPS determines the instantaneous position of the airplane: 
Fig.4 shows the stabilizer and associated control; 

Fig.5 shows how the three-line sensor camera takes a picture of a selected piece of land when the airplane is on 
the proper course with its attitude retained idealiy; 

Fig.6 shows how the three-line sensor camera takes a picture of a selected piece of land when the airplane is roll- 
so ing; 

Fig-7 shows how the three-line sensor camera takes a picture of a selected piece of land when the airplane is pitch- 
ing; 

Fig.8 shows how the three-line sensor camera takes a picture of a selected piece of land when the airplane is yaw- 
ing; and 

35 Fig.9 is a flow chart according to which the dara processing unit effects the processing of data. 

BEST MODE OF REDUCING THE INVENTION IN PRACTICE 

Referring to the accompanying drawings, an airborne photographing apparatus according to one embodiment of 
40 the present invention is described as follows. Refernng particularly to Fig.1 , it uses a three-line sensor camera 1 . which 
, comprises mree.CCD.line sensors-la.~lb and~lc arranged in parallel,-each taking a picture of a s 
at a different angle, and analogue-to-digitai converting the so taken land image for sending the digital land image data 
to an associated data processing unit 5. 

A gyro 2 is fixed to the housing of the three-line sensor camera 1 . thus determining the attitude of the camera in 
45 terms of the inclinations about three coordinate axes ( roll angle co. pitch angle ^ and yaw angle u ). 

A global positioning system (abbreviated as "GPS") 3 is responsive to electromagnetic waves from selected artifi- 
cial satellites for determining the instantaneous position of the receiving object {airplane or ship) in the three dimen- 
sional space. 

In the present invention an airborne GPS is used for determining the instantaneous position of the three-line sensor 
50 camera 1 {Xq, Yq, Zq) while photographing in the three-dimensional space. 

Fig. 2 illustrates how the three-line sensor system used in the present invention works. 

As seen from Fig.2, three different corresponding points (xi.yj: i^ 1 . 2 or 3) are formed on three digital land images 
respectively 

. ) ""^^ '"stantaneous sensor position is given by ( Xoi , Yqi, Zoi). and the different inclinations are given by { a> j, 4* j and 
One of the corresponding points (x, y) is given by the foltowing equations: 
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aifX-XoHa2(Y-Yo)+a3(Z-Zo) 
3 7 {X-X o)+a 8 (Y- Y o)+a 9 (2-Z q) 

■ a4(X-XoKa5(Y-Yo)+a6(Z-Zo) 
" a7(X.Xo)+a8(Y-Yo)+a9(Z-Zo) 



. , where f stands for focal length. 
. TO These equations can be converted as follows : 



Xo — u 2 0 



{ 



X-u Z = 
Y-v 2 = 



3D . . , a, x+a4y-a7f . ag 

.where u = — ' . . and v =t — 

agx+agy-agf a 3 

ag are given by the following rotational matrixes. 
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^ - r+a distance from the center to the backward- 

oblique sensor 

.where u^\o distance from the center to the vertical 
sensor 

^-d distance from the center to the forward- 
oblique sensor 



d: distane from the center of the arranged sensor 

so 

The above two equations are held for each con-esponding point and the three-dimensional coordinates (X, Y. Z) in 
the land surface can be determined from six equations in total according to the method of least squares. 

Fig.3 shows how the GPS works in determining the instantaneous position of the camera. 

As seen from Rg.3. the airplane or ship A bearing a GPS receives signals from four artificial satellites S seleaed 
55 among those flying in the space, determining the distance to each artificial satellite. The instantaneous position of each 
artificial satellite is determined at the time of photographing by using the presumable orbit data of the artificial satellite 
S available from the stationary station P on the ground, and then, the receiving station (airplane A) is located on the 
surface of each sphere having a radius of the so determined distance from the stationary station P to the airplane A with 
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its center on the artificial satellite. Such calculations are performed on four or more artificial satellites, and the receiving 
station (airplane A) is located continuously in the kinematic or differential mode. 

A stabilizer 4 absorbes the vibration of the airplane, and at the same time it controlls frie attitude of the airborne 
camera. 

5 Fig. 4 shows the controlling mechanism of the stabilizer. As shown in this drawing, the three-line sensor camera 1 
has a gyro 2 integrally connected thereto, and the gyro 2 provides voltage signals to control the motors (M1, M2, M3) 
of the three-axis attitude control mechanizm, thereby putting the camera in alignment with a given fixed direction. 
Figs.5 to 8 show how the three-line sensor camera 1 photographs a piece of land. 

Referring to Fig. 5, the airplane A is flying on a given course at a predetermined height and in a predetermined 
10 direction. In tiiis ideal case the airborne three-line sensor camera 1 is directed vertically all tiie time, thus providing com- 
plete land images, which are free of distortions, losing no fraction of data, 

It is, however, actually impossible that the airplane flies always on the ideaJ course, and it is liable to deviate from 
the proper course when being adversly affected by wind and other weather factors. Fig.6 illustrates how the piece of 
land is swept when the airplane is rolling; Rg.7 illustrates how the piece of land is swept when the airplane is pitching; 
, 15 and finally Fig.8 illustrates how the piece of land is swept when the airplane is yawing. 

It is, therefore, necessary that the three-axis attitude control mechanism be controlled on real time so as to hold the 
attitude of the airborne camera vertically at a fixed height, thus putting its sensors in cmdition in which they may 
traverse tiie proper flight course. 
y Assume that the attitude of ^e airplane is recorded while photographing in place of controlling the attitude of the 
20 airplane, thus allowing the airborne camera to scan out of tiie land-sweeping range when the airplane inclines to follow 
the correct flight course. In this case the reproduced land image wiit be. incomplete, losing some fractions of land image 
data. Even though the arplane is on the correct flight course, the airborne camera when inclining about any of the three 
coordinate axes as shown in Figs.6 to 8, will fail to scan across the selected strip of land completely, and ttie reproduced 
image cannot be interpolated or extrapolated for providing a complete land image. Such interpolation or extrapolation 
25 if possible, will take much time involved for computor processing. 

Fig. 9 is a flowchart showing the processing of data carried out by an associated data processor. 
As shown in Fig. 9. the data processor 5 effects the processing of attitude data from the gyro 2 and the instantane- 
ous position data from the GPS 3 for outputting signals to control the stabilizer 4. 

A decision as to whether or not the airplane is flying straight on the proper flight course can be made from the 
30 instantaneous position data from the GPS 3. Also, a decision as to whether or not the airplane has a turn to the side 
can be made from the data of yaw angle avail afcrie from the gyro 2 (particularly such turn caused by traversing wind). 
Accordingly a required correction can be made for directing the airborne camera to be transverse to the proper flight 
course (or making the airborne camera to scan transversly across the strip of land), which correction is called "drift- 
angle correction" or "yaw correction". 
35 The data processor 5 transfers data of land image from the camera 1 , data of the attitude of the airplane from the 
gyro 2, and data of tiie instantaneous position of the airplane from the GPS 3 to the data recorder 6. From these data 
produced are signals to control the motors of the stabilizer for setting the optical axis of the airborne camera 1 to be 
vertical. 

The data recorder 6 is a digital recorder which is capable of recording digital data at an increased rate, thus permit- 
40 ting the real-time recording of the land image data, which is transfered from the camera 1 to the data processor 5. At 
the same time, data of the attitude available from the gyro 2, and data of the instantaneous position available trom the - 
GPS 3 are recorded synchronously with each scanning line of. the land image data. 

The image display 7 shows the land image taken by the airborne camera 1 on real time, thereby permitting a deci- 
sion as to whether or not the airplane is now on the proper flight course to be made. 
45 The data analizer 8 on the grourKl makes required corrections of the lens aberration, CCD characteristics and other 
proper factors on the basis of land image data, the attitude data and the position data all recorded on \he data recorder 
6 to provide land image data in terms of fixed coordinates for each pixel. The land image data thus provided can be 
used in driving the software pertaining to the digital photogrametry. 

50 DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

As may be understood from the above, a three-line sensor camera photographs a selected piece of land continu- 
ously to provide land image data taken at three different angles, thereby permitting the analyzing of the land in terms of 
shape and height on real time. Also, attitude data is availat^e from the gyro integrally connected to the camera, and the 
55 feed-back controlling of the camera is effected on the basis of the attitude data so as to direct the optical axis of the 
camera in the vertical direction ^all the time, and at the same time to direct the line sensors to be transverse to ttie flying 
course, thus assuring that the land image data is free of distortion. Thanks to this art line sensors which have been hith- 
erto thought to be used only in stable artificial satellites can be on board for making records of digital land images. 
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In addition to land image data recorded in the digital form the attitude data available from the gyro and the position 
data available from the GPS are recorded together. 

Advantageously all these recorded data are used for processing photographs, thereby permitting the digital pho- 
tomapping with precision at an increased efficiency, and no reference-point finding work is unnecessary. 

5 

Claims 

1. An airborne photographing apparatus comprising: an airborne three-line sensor camera for taking pictures of a 
selected piece of land; a gyro mounted in the housing of the three-line sensor camera for determining the attitude 

10 of the camera while photographing; a GPS for providing the instantaneous position data of the camera in the three- < 
dimensional space; a stabilizer for controlling the attitude of the camera to set its optical axis to be vertical at ail 
times, and at the same time for absorbing the vibration of the aeroplane; a data processing unit for processing the 
attitude data from the gyro and the position data from the GPS and outputting signals for controlling the stabilizer; 
a data recorder for recording Oie land image data from the camera, the attitude data from the gyro and the position 

15 data from the GPS; an image display for showing the land Image data from the camera; and a data analyzer for 
converting the land image data from the camera into the land image data given in terms of fixed coordinates on the 
basis of the land image data, attitude data and position data all recorded by the date recorder, and for outputting 
the so converted land image data. 
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Fig. 9 
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